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Cross-Reference to Related Application 
[0001] This application draws priority from U.S. Provisional Application No. 

60/440,368, filed on January 16, 2003, and hereby incorporated by reference in its 
entirety. 

Background of the Invention 

Field of the Invention 

[0002] Embodiments of the present invention relate to system architectures for 

the processing of radiological images. More specifically, embodiments of the 
present invention relate to network-based architectures for interfacing image 
processing apparatus with image acquisition and/or display apparatus. 



Related Art 

[0003] The medical community has developed ways of sharing data, in 

particular image data, among its members in order to improve communication of 
information about patients and between medical professionals. The primary 
improvement in data sharing occurred with the implementation and adoption of 
the Digital Imaging and Communications in Medicine (DICOM) standard. The 
DICOM standard, currently in version 3.0, standardizes image file formats and 
commands across a networked environment. 

[0004] Computer aided detection (CAD) systems use digital processing 

methods to assist users in identifying abnormalities from medical images. The 
CAD system is a computer system that receives a patient's diagnosis images such 
as, for example, x-ray images, pap smear images, mammograms, etc.; processes 
the patient's diagnosis images; and generates the CAD results indicating either 
potential abnormalities on specific locations (for example, the location of a 
disease) in the patients' diagnostic images. A physician or health care provider 
can then use the CAD results, along with other tools and information, to determine 
the location and condition of diseases for the patients. 

[0005] Current diagnostic imaging and results-disseminating solutions do not 

take into account the provisions for patient confidentiality contained in the Health 
Insurance Portability and Accountability Act of 1996. For example, image file 
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names routinely contain information that readily identifies the patient to whom the 
image corresponds. Further, imaging and CAD activities take place outside of the 
DICOM network, and images must be copied or moved to the network if they are 
to be shared. 

[0006] Additionally, current diagnostic imaging processes are not robust in the 

event of real-time system failures, such as power failures or network failures. 
When failures occur, the CAD process must often be redone because there is no 
way to know which images have already been processed. The duplication of effort 
wastes time, resources and money. 

[0007] What is needed then is a system that overcomes the shortcomings of 

conventional solutions. 



Summary of the Invention 

[0008] In an exemplary embodiment of the present invention a system for 

network-based computer aided detection (CAD) is disclosed. 

[0009] An exemplary embodiment of the present invention combines CAD 

processing with a DICOM 3.0 Medical Imaging Network. The combination: 
allows automatic processing to generate a CAD result; allows users to retrieve the 
images, after the CAD processing, directly from the DICOM network; allows the 
CAD processor to connect multiple film digitizers; allows the CAD processor to 
connect multiple computed radiograph (CR) image processors; and allows the 
CAD processor to connect multiple digital X-ray (DX) imaging systems. The 
technique may be extended to other imaging modalities and many disease types. 

[00010] Further features and advantages of the invention, as well as the 

structure and operation of various embodiments of the invention, are described in 
detail below with reference to the accompanying drawings. 



Brief Description of the Drawings 
[0001 1] The foregoing and other features and advantages of the invention will 

be apparent from the following, more particular description of various 
embodiments of the invention, as illustrated in the accompanying drawings 
wherein like reference numbers generally indicate identical, functionally similar, 
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and/or structurally similar elements. The left most digit in the corresponding 
reference number indicates the drawing in which an element first appears. 
[00012] FIG. 1 depicts an exemplary embodiment of a system of the present 

invention; 

[00013] FIGS. 2A and 2B depict exemplary embodiments of the modules of the 

system according to the present invention; 
[00014] FIG. 3 depicts an exemplary embodiment of the method of the present 

invention; 

[0001 5] FIG. 4 depicts an exemplary embodiment of a recovery method 

according to the present invention; and 
[00016] FIGS. 5 A and 5B depict an exemplary embodiment of an image file 

name according to the present invention. 



Detailed Description of Various Embodiments of the Invention 
[00017] Various embodiments of the invention are discussed in detail below. 

While specific exemplary embodiments are discussed, it should be understood that 
this is done for illustration purposes only. A person skilled in the relevant art will 
recognize that other components and configurations can be used without departing 
from the spirit and scope of the invention. 
[00018] In an exemplary embodiment, the system combines a computer aided 

detection (CAD) processor with a communication network to streamline the CAD 
processing and distribution of diagnostic images. In the discussion below, the 
network being discussed is a DICOM-based network; however, the invention is 
not to be understood as being limited to this embodiment, and the network may be 
any appropriate network. The combination of CAD processing with 
communication network is implemented in such a way as to greatly improve the 
ability to recover from power or network failures. The overall input/output 
scheme between the network and the CAD processor is also designed to operate 
asynchronously, as CAD processing time may be greater than the peak image 
input rate, especially when more than one image modality port is present. The 
system is also designed to allow recovery from a power failure or other events that 
interrupt normal operation. 
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[00019] FIG. 1 depicts an exemplary embodiment of a system of the present 

invention. In particular, it shows the major functional elements of a minimum 
configuration of the CAD processor and the main control paths. The DICOM 
network backbone 102 can be coupled to a primary review workstation 104, one 
or more workstations 106, the CAD processor 108 and a DICOM image archive 
110. The DICOM network can use, for example, the TCP/IP communications 
protocol. Possible image sources include devices that provide computed 
radiographs (CR) 1 12, digital X-rays (DX; also known as Digital Radiography, or 
DR) 1 14, and film digitization 1 1 6. 

[00020] One or more network connections use the DICOM 3.0 standard 

protocols for medical image formatting and transmission. Multiple film scanners, 
computed radiograph image producing devices, digital radiography imagers, and 
servers or archive devices can be configured to connect to one or more CAD 
processors. The CAD processor may also use wireless mechanisms to receive 
images for processing. 

[00021] The CAD processor receives images via a network connection using 

the DICOM 3.0 standard protocols for medical image formatting and 
transmission. The CAD processor normalizes the input images, performs complex 
and proprietary processing to detect nodules or other indications of disease on the 
images, and provides the results of the nodule detection to either the DICOM 
network node that sent the images and/or to a predetermined list of nodes. 

[00022] FIG 2A is a block diagram showing an exemplary embodiment of the 

system of the present invention. The network interface block 204 is the software 
provided by the operating system to operate the network interface controller, 
which interfaces with the DICOM network 202. The TCP/IP communications 
protocol implementation is compatible with the DICOM 3.0 standard. The 
DICOM Receive Service 206 receives DICOM images generated by imaging 
modalities, generates asynchronous notifications to the image processing 
application upon receiving events, transmits images to configured and/or multiple 
destinations, allows the insertion of processed pixel information, allows the 
insertion of textual DICOM header information, allows the insertion of DICOM 
overlays, allows file parsing of locally stored DICOM images, allows file storage 
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of generated DICOM images on local storage, and complies with DICOM 3.0 
Conformance Statements for computed radiograph (CR), digital X-ray (DX), and 
secondary capture (SC) images and transfer criteria. 

[00023] The image file format converter 210 receives image files from the 

input image file buffer 208 and works in concert with the DICOM receive service 
206 and the service request control block 218 to handle input images, strip off the 
DICOM header of each image, adjust the size of each image to the number of 
rows and columns that are accepted by the disease-specific CAD processor 212 
and also adjust the pixel depth (number of bits per pixel) to the range required by 
the CAD processor 212. The CAD processor 212 can be disease-specific, or it can 
detect multiple diseases. The stripped-off DICOM header is stored with its 
corresponding input image in the same format in which it is received, so all the 
necessary data in the header for evaluating and converting an image is available 
for the image file format converter 210. 

[00024] Other functions of the image file format converter 210 can include byte 

swapping and converting from signed to unsigned values. 

[00025] In an exemplary embodiment of the CAD processor 2 1 2, three 

detection results images can be generated: (1) a derived, full resolution image with 
regions of interest (e.g. the nodule locations) burned into the image; (2) a derived, 
reduced resolution image with regions of interest burned into the image; and (3) a 
fiill resolution image with a graphical result and/or location information supplied 
in an overlay plane. The output files with burned-in images are placed into the 
output burned-in image file buffer 226. The output files with the separate overlays 
are placed into the output overlay image file buffer 224. The DICOM Send 
Service 207 sends DICOM images to predetermined destinations on the DICOM 
network. 

[00026] The service request control block 218 controls the reading of the image 

input buffer 208, the CAD processor 212, the output buffers 224 and 226, and 
other real-time operational functions of the CAD processor 212. The input buffer 
control 216 detects when the output buffer control 222 has indicated that the 
output buffers 224 and 226 are full and/or that the CAD processor 212 is busy. 
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Logging services 220 captures status and error data output from the service 
request control block 218 during processing. 

[00027] In an exemplary embodiment, the CAD processor 212 can read output 

images directly from the output buffers 224 and 226 and distribute the images 
automatically to predefined DICOM nodes on the DICOM network. 

[00028] FIG 2B is an alternate view of the same exemplary embodiment of the 

system of the present invention. This view emphasizes the roles of the three 
services contained within the CAD Processor Software (Receive, Detect, and 
Send). For example, the DICOM Receive Service, which can comprise the 
DICOM receive 206, the input buffer control 216 and the input image parameter 
checking 228, performs the input image parameter checking 228 before sending 
images to the Detection Service's image file format converter 210. Similarly, the 
DICOM Send Service, which can comprise the DICOM image generation 230, the 
output buffer control 222 and the DICOM send 207, performs DICOM image 
generation 230 on the results produced by the Detection Service's disease-specific 
CAD processor 212. s 

[00029] FIG. 3 depicts an exemplary embodiment of the method of the present 

i invention. The system receives a medical image from the DICOM network in step 
302. The image is then added by the DICOM service broker 206 to an input file 
buffer 208 in step 304. The input file buffer 208 is preferably a circular buffer. 
When full, the input file buffer 208 can overwrite the oldest images or reject any 
new images, depending on a parameter set by the user. The image file is then 
renamed in step 306 in order to remove any identifying patient information from 
the file name and also to create a unique file name, enabling asynchronous 
processing. The input image file name is discussed further in reference to FIGS. 
5Aand 5B. 

[00030] Once renamed, the image file format is then converted in step 308. 

Incoming image files may be in several formats, and are converted into one single 
format for use in the CAD processor. After file format conversion, the CAD 
processor performs computer aided detection on the image in step 310, when the 
CAD software signals that it is ready to process an image. The CAD software will 
indicate that it is busy and cannot accept any input when it is processing an image 
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and/or when there is no space to write an output image into the output buffers. 
Some exemplary processes of computer aided detection are described, for 
example, in U.S. Application No. 09/625,418 entitled "Fuzzy Logic Based 
Classification (FLBC) Method for Automated Identification of Nodules in 
Radiological Images," filed July 25, 2000, now U.S. Patent No. 6,654,728; in U.S. 
Application No. 09/503,840 entitled "Divide-and-Conquer Method and System for 
the Detection of Lung Nodules in Radiological Images," filed February 15, 2000, 
now U.S. Patent No. 6,549,646; in co-pending U.S. Application No. 09/503,839 
entitled "Automatic Method and System for the Detection of Lung Nodules in 
Radiological Chest Images Using Digital Image Processing and Artificial Neural 
Network," filed February 15, 2000; and in co-pending U.S. Patent Application No. 
10/606,120, filed June 26, 2003, all of common assignee, and incorporated herein 
by reference in their entirety. 

[00031] Generally, the exemplary CAD software can perform multiple phases 

of image processing, neural network analysis, feature extraction, and fuzzy logic 
processing to identify regions of interest (ROI) indicating the potential areas of 
disease from various image types. The detection software can be supplied as a 
■ standard library (.DLL; .OCX, .LIB, etc.) with a common application 
programming-interface (API) for easy integration. 

[00032] From the detection results, the CAD processor creates an overlay file 

indicating any ROI in step 312. The overlay information can be kept separate 
from the original file in overlay output file 3 14a, or the overlay information can be 
burned into the original file in burned-in image file 314b. The output files are 
then placed in their appropriate output buffers in step 316. As discussed above, the 
overlay output file has a separate buffer 224 from the burned-in image files, which 
go into burned-in image file buffer 226. 

[00033] When an output file is placed in the output buffer, the corresponding 

unprocessed input file is deleted from the input buffer in step 3 1 8. Then, the 
output file is delivered to its destination via the DICOM network in step 320. 
Examples of destinations include, but are not limited to, review workstations, 
storage archives, etc. The service request control block 218 will delete the 
associated output image from the output buffer when the DICOM service broker 
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signals successful transmission of the file to its destination(s) in step 322. 
Processing is finished at end-block 324. 

[00034] Accordingly, at any point in time, the input buffer will contain only 

images that require processing, and the output buffers will contain only processed 
images that have not be sent. When the system is idle, there are no images in the 
input or output buffers. Maintaining the buffers in this manner improves the 
efficiency of the system in the event of a failure because the system will not need 
to reprocess any images. 

[00035] To improve the robustness of the system, the service request control 

block 218 stores the value of the image that is being processed or that was last 
processed if the processor is idle. The service request control block 218 can also 
store an up/down counter that counts up the number of images input and counts 
down each time an image is processed. The values may be stored, for example, in 
a temporary file, in an operating system registry file, such as the Microsoft 
Windows® operating system registry, or both. The count value can always be 
verified by a startup routine and/or an error checking routine that counts the 
. number of files remaining in the input buffer. A similar counter and checking 
scheme;can control the output buffers. The actual file names in the input and „■ H> 
output buffers can be compared, and by testing the various matches and > ;> 
mismatches that exist, the state of the CAD processor at the time of any failure 
can be deduced. 

[00036] FIG 4 is a flowchart for the method of recovery according to the 

present invention. When the failure, either power or network, is resolved in step 
402, the processor initialization module checks the contents of the input buffer in 
step 404 and of the output buffer in step 406. If both buffers are empty, in step 
408, a counter Z used to generate filenames is reset to zero in step 410, and the 
system can resume normal operation in step 420. If the buffers are not empty, the 
system determines the highest Z value count used before the system abnormally 
terminated and sets the new count value to this maximum value plus one in step 
412. Next, any files waiting in the output file buffer are sent to their destinations 
in step 414. Then any files waiting in the input file buffer are CAD-processed in 
step 416. From there, normal operation of the system can resume in step 420. 
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[00037] FIGS. 5A and 5B depict an exemplary embodiment of an image file 

name according to the present invention. The DICOM service broker 206 assigns 
a unique non-repeating number or value as a file name for the input image as it is 
written into an input buffer folder on disk and uses that same number or value to 
name the output files in their respective buffers. The value of the file name allows 
asynchronous image input, asynchronous CAD detection and asynchronous output 
of an overlay image and a derived image with burned in ROI. 

[00038] The input image file name 502 can be constructed as shown in FIG 

5A. The N value 504 is a four-digit decimal number that increments by one for 
each input image placed into the input buffer by the DICOM Receive Service. 
The N value is reset to zero at system power on or at reboot if all input and output 
buffers are empty. The PT value 508 is a one digit decimal number of the 
modality port that supplied the input image. The MT value 506 is a one digit 
decimal number that encodes the type of imaging modality that supplied the input 
image. FIG 5B shows a suggested example of codes. For example, an MT value 
of 0 could mean that the image is on digitized film. The "I" in field 5 1 0 indicates 
m that this file is an input file. 

[00039] Output file names preferably have the same format as input image file 

f '■ i names, iexcept that instead of an "I" in field 5 1 0 at the end of the file name, the- 
full resolution output image file name has an "F", indicating that the file is a full 
resolution output image with ROI coordinate information in an overlay plane. The 
N, MT and PT values are the exact values copied from the corresponding input 
image that resulted in the output image. The derived image file name, instead of 
having an "I", can have a "D", indicating that the file is a reduced resolution 
output image with ROI marks burned into the image. The N, MT and PT values 
are, again, the exact values copied from the corresponding input image that 
resulted in the output image. 

[00040] Note that various embodiments of the invention may be implemented 

in the form of hardware, software, firmware, etc., or combinations thereof. As an 
example, embodiments of the invention may be implemented as software code 
embodied on a machine-readable medium. Examples of such a machine-readable 
medium include, but are not limited to, a hard disk, a floppy disk, semiconductor 
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or other types of memory, a CD, a DVD, RAM, ROM, a modulated 
communication signal, etc. Embodiments of the invention may also be 
implemented in the form of a computer system, having at least one processor, 
adapted to perform a method according to an embodiment of the invention. 
[00041] While various embodiments of the present invention have been 

described above, it should be understood that they have been presented by way of 
example only, and not limitation. Thus, the breadth and scope of the present 
invention should not be limited by any of the above-described exemplary 
embodiments, but should instead be defined only in accordance with the following 
claims and their equivalents. 
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